Skip to content

Add Annotation AI Pipeline tutorial (marine species — Project Moorev)#6973

Open
TuturBaba wants to merge 14 commits into
galaxyproject:mainfrom
TuturBaba:Anootation_marine
Open

Add Annotation AI Pipeline tutorial (marine species — Project Moorev)#6973
TuturBaba wants to merge 14 commits into
galaxyproject:mainfrom
TuturBaba:Anootation_marine

Conversation

@TuturBaba

Copy link
Copy Markdown
Contributor
  • Adds a new GTN tutorial teaching a two-step AI annotation pipeline for marine species images/videos: automatic annotation with SAM3 Semantic Segmentation (text-prompt based), then correction/validation with Edit COCO Annotation and COCO Annotation Visualizer.

  • Available in French (tutorial_FR.md)

  • Uses a real video clip from the Moorev project (Sorbonne Université / MNHN / CNRS), hosted on Zenodo, with a data-library.yaml entry for import.

  • Adds supporting assets: screenshots/GIFs illustrating SAM3 and COCO Visualizer output

@bgruening

Copy link
Copy Markdown
Member

Very cool!

@bgruening

Copy link
Copy Markdown
Member

@Marie59 do you have time to review?

@Marie59

Marie59 commented Jul 16, 2026

Copy link
Copy Markdown
Collaborator

@Marie59 do you have time to review?

Guten tag ! Sure will do by the en of the day !

@yvanlebras

Copy link
Copy Markdown
Collaborator

THANK YOU Arthur, Björn Marie !!

> - {% icon param-file %} *"Model data"*: `Segment Anything Model 3 (SAM 3)` (default)
> - {% icon param-select %} *"Input type"*: `One video`
> - {% icon param-file %} *"Input video file"*: `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon param-select %} *"Video quality"*: `Original quality (lossles)` (default)

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-select %} *"Video quality"*: `Original quality (lossles)` (default)
> - {% icon param-select %} *"Video quality"*: `Original quality (lossless)` (default)

Comment on lines +127 to +130
> - {% icon param-file %} *"Input video file"*: `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon param-select %} *"Video quality"*: `Original quality (lossles)` (default)
> - {% icon param-select %} *"Additional output formats"*: `Empty` (default)
> - {% icon param-select %} *"Export individual frames"*: `Both annoted and raw frames`

@Marie59 Marie59 Jul 17, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-file %} *"Input video file"*: `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon param-select %} *"Video quality"*: `Original quality (lossles)` (default)
> - {% icon param-select %} *"Additional output formats"*: `Empty` (default)
> - {% icon param-select %} *"Export individual frames"*: `Both annoted and raw frames`
> - {% icon param-file %} *"Input video file"*: `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon param-select %} *"Video quality"*: `Original quality (lossles)` (default)
> - {% icon param-select %} *"Additional output formats"*: `Empty` (default)
> - {% icon param-select %} *"Export individual frames"*: `Both annoted and raw frames`

@Marie59 Marie59 Jul 17, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe add here a small indent to show this parameters depends on the choice of this input type

> - {% icon version %} *"Confidence threshold"*: `0.5`
> - {% icon version %} *"Video frame stride"*: `5`
> - {% icon param-toggle %} *"Show bounding boxes on annotated output"*: `Yes`
> - {% icon param-toggle %} *"Normalize outputs?"*: `No` (default)

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-toggle %} *"Normalize outputs?"*: `No` (default)
> - {% icon param-toggle %} *"Inference image size"*: `644 (default, balanced)` (default)
> - {% icon param-toggle %} *"Normalize outputs?"*: `No` (default)

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As you wrote all the parameters for concistency maybe also this one ?

Comment on lines +181 to +190
> - {% icon param-repeat %} *"1: Track to keep"*
> - {% icon param-text %} *"Track IDs"*: `0,4-6`
> - {% icon param-text %} *"Rename"*: `Gobiusculus flavescens`
> - {% icon param-text %} *"Frame min"*: `Empty` (default)
> - {% icon param-text %} *"Frame max"*: `Empty` (default)
> - {% icon param-repeat %} *"2: Track to keep"*
> - {% icon param-text %} *"Track IDs"*: `2`
> - {% icon param-text %} *"Rename"*: `Crenilabre`
> - {% icon param-text %} *"Frame min"*: `Empty` (default)
> - {% icon param-text %} *"Frame max"*: `Empty` (default)

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-repeat %} *"1: Track to keep"*
> - {% icon param-text %} *"Track IDs"*: `0,4-6`
> - {% icon param-text %} *"Rename"*: `Gobiusculus flavescens`
> - {% icon param-text %} *"Frame min"*: `Empty` (default)
> - {% icon param-text %} *"Frame max"*: `Empty` (default)
> - {% icon param-repeat %} *"2: Track to keep"*
> - {% icon param-text %} *"Track IDs"*: `2`
> - {% icon param-text %} *"Rename"*: `Crenilabre`
> - {% icon param-text %} *"Frame min"*: `Empty` (default)
> - {% icon param-text %} *"Frame max"*: `Empty` (default)
> - {% icon param-repeat %} *"1: Track to keep"*
> - {% icon param-text %} *"Track IDs"*: `0,4-6`
> - {% icon param-text %} *"Rename"*: `Gobiusculus flavescens`
> - {% icon param-text %} *"Frame min"*: `Empty` (default)
> - {% icon param-text %} *"Frame max"*: `Empty` (default)
> - {% icon param-repeat %} *"2: Track to keep"*
> - {% icon param-text %} *"Track IDs"*: `2`
> - {% icon param-text %} *"Rename"*: `Crenilabre`
> - {% icon param-text %} *"Frame min"*: `Empty` (default)
> - {% icon param-text %} *"Frame max"*: `Empty` (default)

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also indent here ?

Comment on lines +214 to +215
> - {% icon param-file %} *"Input video file"*: `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon version %} *"Frame stride"*: `5`

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-file %} *"Input video file"*: `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon version %} *"Frame stride"*: `5`
> - {% icon param-file %} *"Input video file"*: `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon version %} *"Frame stride"*: `5`

> - {% icon param-select %} *"Color mode"*: `Per instance (different color for each annotation)`
> - {% icon param-select %} *"Output image format"*: `PNG (lossless)` (default)
> - {% icon param-select %} *"Output mode"*: `Both (frames and video)`
> - {% icon version %} *"Video frame rate (FPS)"*: `5.0`

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon version %} *"Video frame rate (FPS)"*: `5.0`
> - {% icon version %} *"Video frame rate (FPS)"*: `5.0`

Comment on lines +17 to +22
- Marine ecosystems
- biodiversity
- AI segmentation
- YOLO
- deep learning
- object detection

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The tags here stays in english ?

Comment on lines +129 to +132
> - {% icon param-file %} *"Input video file"* : `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon param-select %} *"Video quality"* : `Original quality (lossles)` (par défaut)
> - {% icon param-select %} *"Additional output formats"* : `Empty` (par défaut)
> - {% icon param-select %} *"Export individual frames"* : `Both annoted and raw frames`

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-file %} *"Input video file"* : `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon param-select %} *"Video quality"* : `Original quality (lossles)` (par défaut)
> - {% icon param-select %} *"Additional output formats"* : `Empty` (par défaut)
> - {% icon param-select %} *"Export individual frames"* : `Both annoted and raw frames`
> - {% icon param-file %} *"Input video file"* : `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon param-select %} *"Video quality"* : `Original quality (lossles)` (par défaut)
> - {% icon param-select %} *"Additional output formats"* : `Empty` (par défaut)
> - {% icon param-select %} *"Export individual frames"* : `Both annoted and raw frames`

Comment on lines +183 to +192
> - {% icon param-repeat %} *"1: Track to keep"*
> - {% icon param-text %} *"Track IDs"* : `0,4-6`
> - {% icon param-text %} *"Rename"* : `Gobiusculus flavescens`
> - {% icon param-text %} *"Frame min"* : `Empty` (par défaut)
> - {% icon param-text %} *"Frame max"* : `Empty` (par défaut)
> - {% icon param-repeat %} *"2: Track to keep"*
> - {% icon param-text %} *"Track IDs"* : `2`
> - {% icon param-text %} *"Rename"* : `Crenilabre`
> - {% icon param-text %} *"Frame min"* : `Empty` (par défaut)
> - {% icon param-text %} *"Frame max"* : `Empty` (par défaut)

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-repeat %} *"1: Track to keep"*
> - {% icon param-text %} *"Track IDs"* : `0,4-6`
> - {% icon param-text %} *"Rename"* : `Gobiusculus flavescens`
> - {% icon param-text %} *"Frame min"* : `Empty` (par défaut)
> - {% icon param-text %} *"Frame max"* : `Empty` (par défaut)
> - {% icon param-repeat %} *"2: Track to keep"*
> - {% icon param-text %} *"Track IDs"* : `2`
> - {% icon param-text %} *"Rename"* : `Crenilabre`
> - {% icon param-text %} *"Frame min"* : `Empty` (par défaut)
> - {% icon param-text %} *"Frame max"* : `Empty` (par défaut)
> - {% icon param-repeat %} *"1: Track to keep"*
> - {% icon param-text %} *"Track IDs"* : `0,4-6`
> - {% icon param-text %} *"Rename"* : `Gobiusculus flavescens`
> - {% icon param-text %} *"Frame min"* : `Empty` (par défaut)
> - {% icon param-text %} *"Frame max"* : `Empty` (par défaut)
> - {% icon param-repeat %} *"2: Track to keep"*
> - {% icon param-text %} *"Track IDs"* : `2`
> - {% icon param-text %} *"Rename"* : `Crenilabre`
> - {% icon param-text %} *"Frame min"* : `Empty` (par défaut)
> - {% icon param-text %} *"Frame max"* : `Empty` (par défaut)

Comment on lines +217 to +218
> - {% icon param-file %} *"Input video file"* : `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon version %} *"Frame stride"* : `5`

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-file %} *"Input video file"* : `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon version %} *"Frame stride"* : `5`
> - {% icon param-file %} *"Input video file"* : `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon version %} *"Frame stride"* : `5`

> - {% icon param-select %} *"Color mode"* : `Per instance (different color for each annotation)`
> - {% icon param-select %} *"Output image format"* : `PNG (lossless)` (par défaut)
> - {% icon param-select %} *"Output mode"* : `Both (frames and video)`
> - {% icon version %} *"Video frame rate (FPS)"* : `5.0`

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon version %} *"Video frame rate (FPS)"* : `5.0`
> - {% icon version %} *"Video frame rate (FPS)"* : `5.0`

> - {% icon version %} *"Confidence threshold"* : `0.5`
> - {% icon version %} *"Video frame stride"* : `5`
> - {% icon param-toggle %} *"Show bounding boxes on annotated output"* : `Yes`
> - {% icon param-toggle %} *"Normalize outputs?"* : `No` (par défaut)

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-toggle %} *"Normalize outputs?"* : `No` (par défaut)
> - {% icon param-toggle %} *"Inference image size"*: `644 (default, balanced)` (par défaut)
> - {% icon param-toggle %} *"Normalize outputs?"* : `No` (par défaut)

> - {% icon param-file %} *"Model data"* : `Segment Anything Model 3 (SAM 3)` (par défaut)
> - {% icon param-select %} *"Input type"* : `One video`
> - {% icon param-file %} *"Input video file"* : `1: Lieujaune-PorzBreign-GOPR5167_Edited.mp4`
> - {% icon param-select %} *"Video quality"* : `Original quality (lossles)` (par défaut)

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> - {% icon param-select %} *"Video quality"* : `Original quality (lossles)` (par défaut)
> - {% icon param-select %} *"Video quality"* : `Original quality (lossless)` (par défaut)

@Marie59 Marie59 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not much to say ... only tiny tiny suggestions (the same in english and french)
This looks great !! Thank you @TuturBaba

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants